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ABSTRACT 

This study examined the effects o 
Chicano and non-Chicano seventh-grade students us 
to those appearing on tests. The sample was 44% C 
non-Chicano. Prior to instruction on factors and 
seventh-grade students in a school were given an 
Test and a Missing Words Test as pretests; before 
the students received pretraining on Arithmetic R 
Missing Words. Following instruction, these tests 
with a test on factors and primes. Data analysis 
pretraining significantly improved the reliabilit 
Reasoning Test for Chicano students; no different 
were found for non-Chicanos nor on the Missing Wo 
analyses indicated that pretraining also improved 
power of the test for Chicano students. (SD) 
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Introduction 

With the cooperation of the San Jose Unified School District 
and Herbert Hoover Junior High School*^, this study was conducted 
by the Stanford Niathematics Education Study Group in June of 1975* 
The study is sinilar to a study by Eernal (l97l). 

Eernal (l97l) investigated the role of task familiarity in relation 
to scores of Chicano students on standardized tests. He found that 
Chicano students benefitted significantly on mental ability tests 
from an intervention which permitted them to learn the test-marking 
strategies. Anglo students did not gain from the intervention. 

Ther experimental treatment of this study, pretraining on parallel 
Items before administration of the predictor tests, was similar to 
Eernal 's (l97l) treatment. Tnis study used two experimenters and did 
not incorporate a bilingual approach as Bernal (1971) did« The 
decision to disregard a bilingual approach was made after reviewing 
the literature concerning language and cultural factors in tests 
(Davis & Personke, I968, I969; Keston & Jimenez, 195^; Massarotti, 1971; 
Palmer & Gaffney, 1972; and Swanson & DeBlassie, 1971^. 

Population 

Herbert Hoover Junior High School was selected for this study 
because of its large Chicano student population. Only seventh grade 
students were involved in the experiment because the instructional 
unit. Factors and Rrimes, was appropriate for seventh grade Chicano 
students. Approximately kk% of the seventh graders used in this study 
were classified as Chicano. All English as a Second Language (ESL) 
students were eliminated from the study due to reading difficulties. 
56^ of the seventh grade population was a combination of Anglo, Black, 
Oriental, and others. 

■^We acknowledge with thanks the cooperation and assistance of the 
principal, Mr. Ralph Pfaff; the vice-principal, Mr . James Murphy; the 
R3 coordinator, Mrs. Riuline Perazzo; the teachers, Mr. Elisha Rirks 
and Ms. Vicki Owyang; and the teachers' aides, Mrs. Evelyn Perez and 
Mrs. Lorraine f-feincebo. 
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Rrocedure 

A. Pretraining — Pretesting 

On the first day of pretesting, each of the eight classes 
was randomly divided into two groups. Group A received pretraining 
on the Arithmetic Reasoning Test, while Group B was administered the 
test using standard procedures. Group A relocated in a room near the 
regular classroom, and the experimenter pretrained Group A on the 
strategies of marking the test. The pretraining occupied approximately 
20 minutes of the class period. 

Each student in Group A was handed a mimeographed sheet containing 
one example of a single operation problem parallel to the items on 
the Arithmetic Reasoning Test. The experimenter then read the problem, 
explaining to the students tha1i.they should ignore the four answer 
choices the first time through the problem. The students then tried 
to do the problem. After the student tried the problem, he compared 
his algorithm with the answer choices. The students were then handed 
a second mimeographed sheet, containing the second eiample to be used 
as a pretraining item. This time the students were asked to work the 
problem by themselves.. After they reached a conclusion, the experimenter 
asked a few of them to explain how they arrived at their answer. During 
this time, the experimenter corrected their procedures or strategies 
if there were misunderstandings or misconceptions about the strategy. 
A third problem was then handed out to the students, and they again 
worked through the problem and discussed the procedure with the 
experimenter. Next, the experimenter discussed the strategy for a 
compound problem (see appendix for example). Only two examples were 
given of a compouM problem. The students then returned to their 
regular classroom and the Arithmetic Reasoning Test was administered 
to the entire class. This procedure was used for all eight classes 
in the study. 

On the second day of pretesting. Group B was pre::.rained on the 
Missing Words Pretest, and Group A received the standard administration • 
of the test. Group B relocated in a room near the regular classroom 
with the experimenter. The experimenter gave the students a mimeo- 
graphed sheet containing one example of a Missing Words item. This 
example contained the complete paragraph with particular words underlined. 
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On the same sheet, the paragraph appeared with the underlined words 
deleted and replaced by blanks • The experimenter explained how the 
Missing Words Test was developed, and gave the students general 
instructions as to how to mark the test. 

• The experimenter explained the strategy of reading the entire 
paragraph first, then trying to fill in the missing words. The fact 
that there is only one correct word for each blank was stressed. A 
second mimeographed sheet was then handed to the students; this sheet 
contained an example of another Missing Words problem. 

The students were asked to read the entire paragraph with the 
blanks — then try to fill in the missing words. The experimenter then 
asked the students to explain their strategy when they completed the 
problem. Two more Missing Words Problems were then given to the students. 
After pretraining, the students returned to their regular classroom 
and the Missing Words Pretest was administered to the entire class. 
This procedure was used for all eight classes in the study. 

On the first day of pretesting. Group B was administered the 
Computation and Comprehension Pretests while Group A was pretraining. 
On the second day of pretesting. Group A was administered the Computation 
and Comprehension . Pretests while Group B 'was pretraining. On the third 
day of pretesting, all students were administered the Factors and Primes 
Pretest. 

The Missing Words Test was designed to measure the ability to 
read mathematical prose. An account of the development of this test 
is found in SMSG Wroking Paper* No. 11^ by Roger Jarvis. The Arithmetic 
Reasoning Test (also named Necessary Arithmetic Operations) has been 
administered to both Anglo and Chicano students. The results of one 
study produced a high reliability coefficient and a high correlation 
with mathematics achievement for Anglo students, but a low reliability 
for Chicano students (SMSG Working F^per No. 5)- A second study 
produced almost identical reliabilities for Anglo and Chicano students, 
but a very low correlation with mathematics achievement for Chicano 
students (SMSG Working Paper No. 12). 

B. Pre -Program 

Also on the third day of the study, the booklet entitled 
"Programraed-Arithmetic" was given to the students. This five page 
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booklet illustrates the use of programmed texts. Each class was directed 
by a -ember of the SJ^ESG. The programnied Arithmetic booklet was read 
by the SMESG member while the class followed in their own booklets. 

C. Instruction 

After pretraining, pretesting, and discussion of the 
programmed booklets, the students were given a text on Factors and 
Primes. This was their classroom instructional material for 5 days. 
Each student proceeded at his/her ora rate through the text. Vhen 
the student completed the text, the posttest battery was administered. 
After completion of the posttest battery;, the students worked on 
Eactors and Primes, F^rt II, but this was not included in the study. 

D. Posttests 

The posttest battery consisted of a Factors and Primes 
Posttest, the Comprehension Test (identical to the pretest), and the 
Missing Words Test (identical to the pretest). 

Analysis and Results 

The population was divided into four groups for analysis of the 
data. Group 1 consisted of the Chicano students who were pretrained 
on the Arithmetic Reasoning Pretest. Group 2 was the Chicano students 
who were pretrained on the Missing Words Pretest. Group 3 was the 
non-Chicano students who were pretrained on the Arithmetic Reasoning 
Pretest. Group h was the non-Chicano students who were pretrained 
on the Missing Words Pretest. 





Pretrained on 


Pretrained on 




Arithmetic Reasoning 


Missing Words 


Chicano 


Group 1 


Group 2 




W = 26 


N - 35 


Non-Chicano 


Group 3 


Group k 




W - 35 


N = UO 



A. Reliability of Tests 

Before the data analysis was performed, all cases with missing 
test scores were omitted. An Item Analysis was performed on each 



-5- 

pretest and each posttest. The items in the Psictors and Primes Posttest 
vere divided into tvo scal^^s: Scale 1 consisted of computation items, 
and .Scale 2 consisted of >;f./-iei; cognitive ability (understanding) items. 

The means and reliabilities (Cronbach's Alpha) of the Arithmetic 
Reasoning Pretest are sho^uTi in Table 1: » 

TABLE 1 



Reliability Mean 

Group 1 .568 If. 520 

Group 2 .258 3.971 
Group 3 .588 • 5.3^3 
Group k .^79 6,075 



From these results, it is clear that pretraining improved the reliability 
of the Arithmetic Reasoning Pretest for Chicano students but not for 
the non-Chicano students. 

The means and reliabilities (Cronbach's Alpha) of the Missing 
Words Pretest are shown in Table 2; 

TABLE 2 



Reliability Mean 






Group 1 .852 


l8.61fO 






Group 2 .866 


17AOO 






Group 3 .775 


22.91^ 






Group k i .875 


23.725 






The Missing Words Pretest did 


not show improved reliability 


for 




either ethnicity or treatment 


group . 






Tiie means and reliabilities of the Computation Pretest, 


the 




Comprehension Pretest, and the 


J Factors and Primes Pretest are shown 




in. Table 3: 


TABLE 3 






Computation 


Comprehension 


Factors 


and Primes 


Group 1 o< = .779 


« = .767 


o< = 


.319 


mean .= 12.760 


mean = 9.720 


• mean = 


2.72 


Group 2 o< = •6J^9 


= .585 


oC = 




mean = 13-171 


mean = 10.i^'86 


mean = 


2.286 


Group 3 = .399 


o< = .515 , 


c< = 


.229 


mean = 13-9^3 


mean - 11.257 


mean = 


2.657 


Group k c< = .k60 


o< = .53^ ^ 


cx = 


.568 


mean = Ik. 025 


mean = 12.050 


mean' = 


2.686 



G 
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The students obtained very low scores on the Pactors and Primes Pretest^ 
which had 8 items.* This indicated that they did not know the material 
contained in the Factors and Primes porgrammed texts. 

Table k shows the means and reliabilities for Scales 1 and 2 of 
the Factors and Primes Posttest (First Achievement Test). 

TABLE k 





Scale 


1 


Scale 


2 




Reliability 


Mean 


Reliability 


Mean 


Group 1 


.505 


7.080 


.21^3 


3.1^80 


Group 2 


.613 


6.311^ ' 


-.039 


2.600 


Group 3 


.719 


9.371 


.k99 


1^.511^ 


Group h 


.71^7 ■ 


10.375 


.577 


1^.825 



The reliabilities of Scale 1 are all adequate for a criterion variable 
in this study. The mean scores of the Factors and Primes Posttest 
Scale 1 indicates that the students did learn some of the material in 
the prof^i-ammed texts. The Factors and Primes Pbsttest Scale 2 is 
unreliable for the Chicano students. 

The means and reliabilities of the Comprehension Posttest (Second 
Achievement Test) are shown in Table 5. 

TABLE 5 





Reliability 


Mean 


Group 1 


.71^6 


lOAOO 


Group 2 


.795 


8.9114- 


Group 3 


.kl2 


11.1^29 


Group h 


.892 


10.925 



B. Regression 

Ai^ter the item analyses, the Pactois and Primes Pbsttest 
Scale 2 was eliminated from further analysis hecmse of its low reliability. 

Three stepwise regression analyses were then performed for the 
Factors and Primes Posttest Scale 1, the Comprehension Posttest, and 
the Missing Words Pbsttest. The independent variables in each of the 
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three stepwise regression analyses were: Arithmetic Reasoning Pretest, 
Missing Vords Pretest, Computation Pretest, Comprehension Pretest, and 
Factors and Primes Pretest- The summar^r' statistics for all the stepwise 
regressions are shown in Table 1 of the appendix. 

Discussion 

A. Pretraining 

The analysis of the A^rithmetic Reasoning Pretest indicates 
that pretrainir.g significantly improved the . reliability of this 
particular predictor test for Chicano students, but did not char.{ze the 
reliability for non^Chicano students. 

There was no significant difference between the reliabilities for 
the pret.rained and non-pretrained groups on the Missing Words Pretest 
for either ethnic group. 

B. Regression 

The regression analysis indicates that the Arithmetic Reasoning 
Pretest is the best predictor of achievement for the Chicano students 
(Group l) who were pretrained on this test. The Arithmetic Reasoning 
Pretest correlates .6? with the Factors' and Primes Fostte^t Scale 1 
for Group 1 and correlates .^0 with the Factors and Primes Pbsttest 
Scale 1 for Group 2. This is a strong indication that pretraining 
Chicano students on this predictor test not only improves the reliability 
but also improves the predictability of the test. 

For Group 2, the best predictor was the Missing Words Pretest, which 
they had been pretrained for. The Missing Words Pretest correlates 
.72 with the Factors and Primes Posttest Scale 1 for Group 2 and 
Correlates .55 with the Factors and Primes Posttest Scale 1 for Group 1. 
As previously stated, pretraining did not improve the reliability of 
this test for any group, but it appears to have improved the predictability 
of this test for Chicano students. 

The Arithmetic Reasdhing Pretest correlates .53 with the Factors 
and Primes Posttest Scale 1 for Group 3 and correlates .^9 with the 
Factors and Primes Posttest Scale 1 for Group k. The Missing Words 
Pretest correlates .31 with the Factors and Primes Posttest Scale 1 
for Group 3 and correlates .52 with the Factors and Primes Pbsttest 
Scale 1 for Croup k. These results indicate that pretraining does not 
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improve the predictability of the Arithmetic Reasoning Pretest for 
non-Chicano students, but appears 'to have improved the predictability 
of the Missing Words Rretest for the non-Chicano group. 

The results reported in this paper tend to confirm Bernal's 
findings: Cliicano students benefit significantly on mental ability 
tests from an intervention which permits them to learn the test- 
marking strategies. Due to tine small sajnple size of this project, 
the results cannot be generalized to the larger population of Chicano 
students. A replication of this study using a larger sample size is 
varranted . 
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APEENDn lABLE 1 



Stepwise Regression; Group 1 



SlMHifiYTAtU CEfL,\r;ENT VAKIAfLE 1 1ST ACh SCAlC I 



VA^lAtLE m 
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FFii-fKTQlS AND PR 

FPt-CChPrt:H£NSION 

fSE-CG/'PJTATION 



VAK 1^0. VAH NO. SIE? 



3 
9 
6 
5 
4 



1 



MLTIPU' ■ 


INCPEASF 


F VALUE ro 




R 




m 


SiN'frR/RE'lOV? 


P 


O.itBO 


0.4A73 




19.4200 


0.0002 


0.7?90 


0.5315 


0.0842 


4.1351 


0.0537 


O.7/1I9 


C.'55C^ 


C.0ie9 


0.9256 


0.3465 


0,71) (,8 


0.5?27 


0.0223 


1.0952 


0.3C7O 


0.7593 


0.5765 


0.0038 


0.1804 


0.6756 
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Stepwise Regreseion; Group 2 



il^^Al^Y Tacl 
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0.5199 
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stepwise Regression; Group 3 



SUMM/HY TA8LE OcPENDSNT VA«UELE 7 IST ACM SCALE I 



VAflAPLc NAME 
PRS-CCPREI-ENSION 

FRE-FACTOSS AND PK 
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VAR no. 
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ENFC RED 

5 
3 
6 
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iTEP, 
NO. 

I 
2 
3 
4 
5 
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F VALUE TO 
ENTER/REMDVE 


P 


0.6138 
0.6741 
0.7303 
0.7:67 
0.7374 


0.3 768 
0.434^ 
0.5333 
0.5^28 
J.54Jn 


0.3768 
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0.0789 
0. 0095 
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Stepwise Regression: Group k 
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